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SUMMARY 


Current  Radar  Warning  Receiver  (RWR)  skills  can  mean  the  difference  between  life  and  death 
for  fighter  pilots.  These  skills  are  so  Important  that  the  pilot  should  not  have  to  think,  but 
should  respond  almost  automatically.  The  pilot  must  understand  the  operation  of  the  Indicator 
control  panel  and  the  azimuth  Indicator,  as  well  as  have  a  current  knowledge  of  threat 
capabilities.  In  order  to  utilize  the  RWR  device.  RWR  skills  are  difficult  to  acquire  and 
maintain.  Pilots  do  not  have  free  time  to  study  and  review  the  written  procedures  as  frequently 
as  necessary  to  stay  current  In  RWR  skills.  In  order  to  practice  RWR  skills  In  the  aircraft, 
aircrews  must  fly  over  Instrumented  ranges.  There  are  very  few  such  ranges,  and  only  limited 
range  time  Is  available  to  Individual  aircrew  members  for  training.  Aircrews  currently  have 
little  opportunity  to  use  their  Electronic  Combat  (EC)  systems,  and  they  need  alternative  means 
of  becoming  proficient  In  order  to  maximize  their  chances  of  survival  In  a  hostile  environment. 

The  RWR  skills  are  difficult  for  aircrews  to  acquire  and  maintain.  A  possible  solution  to 
this  RWR  training  problem  Is  the  application  of  microcomputer  technology  to  develop  Special 
Function  Trainers  (SFTs).  SFTs  are  microcomputer-based  training  aids  designed  to  help  the 
aircrew  member  acquire  new  skills  or  to  refresh  existing  ones.  The  objective  of  this  effort  was 
to  determine  Tactical  Air  Command  (TAC)  pilots'  perceptions  of  the  usefulness  of  the  trainer  as  a 
training  aid.  Questionnaires  were  administered  both  to  Instructor  pilots  and  to  student  pilots. 
Both  groups  found  the  trainer  to  be  "useful*  to  "very  useful*  as  a  training  aid  and  stated  that 
It  would  be  more  useful  to  students  than  to  operational  pilots.  All  evaluators  stated  that  the 
audio  feature  contributed  little  to  the  usefulness  of  the  trainer  and.  In  addition,  stated  that 
several  features  could  be  made  easier  to  use  through  modification.  The  RWR  SFT  offers  flexible, 
relatively  Inexpensive  training  that  the  TAC  pilots  believe  will  be  useful. 
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PREFACE 


This  work  was  conducted  under  work  unit  11232501,  Special  Function  Trainer 
Technology.  The  purpose  of  this  effort  was  to  determine  Tactical  Air  Command  (TAC) 
pilots'  perceptions  of  the  usefulness  of  the  Radar  Warning  Receiver  (RWR)  Special 
Function  Trainer  (SFT)  as  a  training  aid.  Hr.  Garry  Boyle  served  as  the  Project 
Engineer  and  Hr.  Scott  Butzke  and  Hr.  Scott  Mankey  were  the  SFT  software  programmers. 
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RADAR  WARNING  RECEIVER  SPECIAL  FUNCTION 
TRAINER:  PRELIMINARY  EVALUATION 


I.  INTRODUCTION 

Current  skills  In  the  use  of  the  Radar  Warning  Receiver  (RWR)  can  mean  the  difference 
between  life  and  death  for  fighter  pilots.  These  skills  are  so  Important  that  the  pilot  should 
not  have  to  think,  but  should  respond  almost  automatically.  The  pilot  must  understand  the 
operation  of  the  Indicator  control  panel  and  the  azimuth  Indicator,  as  well  as  have  a  current 
knowledge  of  threat  capabilities.  In  order  to  utilize  the  RWR  device.  RWR  skills  are  difficult 
to  acquire  and  maintain.  Pilots  do  not  have  free  time  to  review  and  study  the  written  procedures 
as  frequently  as  necessary  to  stay  current  In  RWR  skills.  In  order  to  practice  RWR  skills  In  the 
aircraft,  aircrews  must  fly  over  Instrumented  ranges.  There  are  only  a  few  such  ranges,  and  only 
limited  range  time  Is  available  to  Individual  aircrew  members  for  training.  As  aircrews 
currently  have  little  opportunity  to  use  their  Electronic  Combat  (EC)  systems,  they  need 
alternative  means  of  becoming  proficient  In  order  to  maximize  their  chances  of  survival  In  a 
hostile  environment. 

A  possible  solution  to  this  RWR  training  problem  Is  the  application  of  microcomputer 
technology  to  develop  Special  Function  Trainers  (SFTs).  SFTs  are  microcomputer-based  training 
aids  designed  to  help  the  pilot  or  aircrew  member  acquire  new  skills  or  Improve  existing  skills. 
From  a  single  microcomputer,  training  can  be  conducted  on  a  variety  of  subjects  through  the  use 
of  unique  software. 

The  Air  Force  Human  Resources  Laboratory  has  developed  unique  software  for  three  models  of 
the  RWR  for  seven  different  aircraft:  the  ALR-46  (A-10,  F-4E,  RF-4C),  the  ALR-69  (A-10,  F-16, 
F-40),  and  the  ALR-62  (F-111).  The  different  aircraft  configurations  of  RWR  were  easily 
accommodated  through  the  use  of  a  touch-sensitive  panel  and  graphic  representations  specific  to 
each  system/aircraft.  Updates  or  modifications  can  easily  be  made  through  modifications  In  the 
software. 

The  objectives  of  this  research  and  development  (R&D)  effort  were,  first,  to  develop  a 
microcomputer-based  RWR  SFT  and,  second,  to  determine  the  perception  of  the  usefulness  of  this 
device  by  Tactical  Air  Command  (TAC)  pilots.  This  paper  will  focus  on  TAC  pilots’  perceptions  of 
the  usefulness  of  the  RWR  SFT  as  a  training  aid.  The  development  of  the  RWR  SFT  Is  treated 
separately  by  Butzke  and  Mankey  (1984). 


Subjects 

Twelve  Air  Force  (TAC)  Instructor  pilots  and  six  student  pilots  participated  In  the 
evaluation  of  the  unclassified  ALR-69  version  of  the  EC  SFT.  Eight  of  the  Instructor  pilots  were 
from  the  Fighter  Weapons  School  at  Nellis  AFB,  and  four  were  from  the  F-16  Replacement  Training 
Unit  (RTU)  at  Luke  AFB.  All  six  students  were  F-16  B-course  student  pilots  from  Luke  AFB.  The 
Instructors  had  a  mean  of  2,142  hours  of  flying  time;  the  mean  flying  time  for  the  students  was 
633  hours. 


II.  METHOD 


Apparatus 

The  RWR  SFT  station  (see  Figure  1)  was  designed  around  a  Cromemco  Z80-based  microcomputer. 
Additional  hardware  needed  to  complete  the  SFT  station  Includes  a  specialized  multi-plane  color 
graphics  system  and  color  monitor,  and  a  touch  sensitive  screen.  This  paper  addresses  the 
evaluation  of  one  version  of  the  AIR-69  for  the  F-16  aircraft. 


Figure  1.  RWR  SFT  Station 


The  RWR  SFT  Is  operated  through  the  use  of  a  menu.  When  the  trainer  Is  started,  a  numbered 
list  of  options  Is  presented.  Including  Interactive  text,  real-time  scenarios,  and  malfunction 
analysis. 

Interactive  Text.  Lessons  are  available  on  audio  Indications,  Indicator  control  button 
operation,  RWR  scope  Interpretation,  and  malfunctions,  to  name  just  a  few.  Text  and  hands-on 
usage  are  combined  to  provide  the  total  concept  of  RWR  operation.  After  reading  the  text  on  some 
RWR  topic,  the  user  can  press  the  touch-sensitive  panel  and  see  a  graphic  demonstration  of  what 
was  Just  read. 

Real-Time  Scenarios.  The  operational  section  of  the  RWR  SFT  provides  the  opportunity  to 
use  the  RWR  as  It  might  be  used  In  actual  combat  (see  Figure  2).  The  RWR  symbology  that  Is  shown 
In  the  figure  Is  representative  of  the  kind  that  a  pilot  might  see  on  a  real  mission.  The 
appropriate  audio  for  each  symbol  can  be  heard.  All  buttons  and  switches  function  as  they  do  In 
the  aircraft. 
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Figure  2.  RWR  SFT  Real-Time  Scenarios 


Malfunction  Analysis.  The  RWR  SFT  Includes  a  comprehensive  malfunction  analysis  package 
covering  some  19  possible  RWR  malfunctions.  Malfunctions  can  be  examined  separately  with  text 
and  graphics  or  In  any  combination  in  real-time  scenarios. 


Procedure 

Each  pilot  received  an  independent  explanation  and  demonstration  of  the  unclassified  ALR-69 
radar  warning  receiver  portion  of  the  RWR  SFT  and  was  then  allowed  to  freely  Interact  with  the 
trainer.  During  this  Interaction  time,  the  pilots  gained  practice  In  the  use  and  content  of  the 
SFT.  A  questionnaire  was  then  administered  to  determine  the  pilots'  perception  of  the  usefulness 
of  the  EC  SFT  as  a  training  aid. 

The  questionnaire  had  a  five-point  rating  scale  ranging  from  "Not  Useful  At  All*  to  "Very 
Useful*  or  "Not  Easy  At  All*  to  "Very  Easy,*  and  each  pilot  rated  four  major  Issues  associated 
with  the  EC  SFT:  usefulness  as  a  training  aid  for  B-course  students,  usefulness  as  a  training 
aid  for  operational  pilots,  overall  usefulness  as  a  training  aid,  and  ease  of  use 
( user-fr lendl Iness) .  The  first  two  areas,  usefulness  as  a  training  aid  for  B-course  students  and 
usefulness  as  a  training  aid  for  operational  pilots,  were  subdivided  Into  the  following 
subject-matter  areas:  Power  On,  System  Test,  Symbology,  Indicator  Control  Panel  Operation, 
Azimuth  Operation,  System  Operation,  Audio,  and  Malfunctions.  The  Item  concerning  ease  of  use 
was  subdivided  Into  the  following  areas:  Instructions,  Touch  Panel,  Graphic  Simulation,  Size  of 
Color  Monitor,  and  Menus.  The  questionnaire  Is  reproduced  In  Appendix  A. 


III.  RESULTS  AND  DISCUSSION 


As  the  data  did  not  appear  to  be  skewed,  the  mean  rather  than  the  median  was  used  as  the 
measure  of  central  tendency.  The  mean  best  reflects  the  total  of  the  scores  and  Is  least 


sensitive  to  sampling  fluctuation  under  ordinary  circumstances.  The  overall  evaluation  of  the 
RWR  SFT  by  the  Instructors  (mean  «  4.83)  and  the  students  (mean  ■  4.33)  Indicates  that  both 
groups  found  the  trainer  to  be  "useful*  to  ‘very  useful"  as  a  training  aid.  Tables  1  through  3 
contain  the  means  of  Instructor  and  student  evaluations. 

Table  1.  Instructors'  Evaluations  of  the  Usefulness  of 
the  RWR  SFT  as  a  Training  Aid  for  B-Course 
Students  and  Operational  Pilots 


B-Course 

Students 

Operational 

Pilots 

Sub-Category  of  RWR 

Mean 

SO 

Mean 

SD 

Power  On 

4.42 

.64 

3.17 

1.14 

System  Test 

4.75 

.43 

3.83 

.69 

Symbology 

4.75 

.43 

3.75 

.60 

Indicator  Control 

Panel  Operation 

4.58 

.64 

3.83 

.69 

Azimuth  Operation 

4.58 

.64 

3.75 

.60 

System  Operation 

4.67 

.47 

4.25 

.60 

Audio 

3.75 

1.09 

3.67 

1.25 

Malfunctions 

4.50 

.65 

4.42 

.64 

Table  2.  Students'  Evaluations  of  the  Usefulness  of 
the  RWR  SFT  as  a  Training  Aid  for  B-Course 

Students  and  Operational  Pilots 

B-Course 

Students 

Operational 

Pilots 

Sub-Category  of  RWR 

Mean 

SO 

Mean 

SD 

Power  On 

4.43 

.45 

3.17 

.69 

System  Test 

4.63 

73 

3.17 

.69 

Symbology 

3.67 

1.49 

3.17 

1.34 

Ina  Control 

Pant.  ration 

4.17 

.69 

3.50 

.96 

Azimuth  /ration 

4.17 

.69 

3.67 

.94 

System  peratlon 

4.33 

.47 

3.50 

.96 

Audio 

3.33 

1.25 

2.67 

1.37 

Malfunctions 


4.17 


37 


3.33 


94 


Table  3.  Instructor  and  Student  Evaluation  of  the 
Ease  of  Use  of  the  Features  of  the  RWR  SFT 


SFT  Feature 

Instructor 

Students 

Mean 

SD 

Mean 

SD 

Instructions 

3.83 

.37 

3.83 

.90 

Touch  Panel 

3.93 

.64 

3.83 

.69 

Graphic  Simulation 

4.2S 

.43 

4.67 

.47 

Size  of  Color 

Monitor 

4.42 

.49 

4.67 

.47 

Menus 

3.92 

.49 

4.00 

.82 

There  Is  little  difference  between  Instructor  and  student  evaluations.  Both  the  Instructors 
and  students  stated  that  the  RWR  SFT  would  be  more  useful  for  B-course  students  than  for 
operational  pilots.  All  evaluators  stated  that  the  audio  feature  In  an  unclassified  format 
contributes  little  to  the  usefulness  of  the  trainer;  It  Is  quite  possible  that  this  feature  jay 
be  of  greater  training  value  In  a  classified  format.  All  evaluators  also  stated  that  the  graphic 
simulation  and  the  color  monitor  were  "easy"  to  "very  easy"  to  use. 

The  Instructions,  touch  panel,  and  menus  were  rated  by  all  evaluators  as  only  "moderately 
easy  to  use."  Modification  of  these  features  may  result  In  Increased  ease  of  use.  The 
Instructions  could  be  made  easier  to  use  through  overall  simplification  and  the  addition  of  an 
escape  key.  The  escape  key  would  allow  the  user  to  exit  the  Instructions  at  any  time. 
Modification  of  the  software  to  Increase  the  accuracy  of  the  touch-sensitive  panel  would  also 
make  the  trainer  easier  to  use.  The  menus  could  be  made  more  user  friendly  through  the  addition 
of  a  "return  to  main  menu  option"  on  all  of  the  sub-menus. 


IV.  CONCLUSION 

The  use  of  microcomputer  technology  offers  one  method  of  providing  a  relatively  Inexpensive 
EC  training  aid  for  today's  pilots.  Preliminary  user  evaluations  Indicate  that  TAC  pilots 
believe  that  the  RWR  SFT  will  prove  to  be  an  effective  training  aid.  The  questionnaire  provides 
Insight  on  the  usefulness  of  the  trainer,  but  Its  training  effectiveness  cannot  be  determined. 
Therefore,  a  transfer-of-tralnlng  study  Is  recommended  to  determine  the  extent  that  knowledge 
acquired  on  the  SFT  transfers  to  operational  environments. 
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APPENDIX  A:  i.  J*R  WARNING  RECEIVER  (RWR) 
PART  TASK  TRAINER  (PTT)  QUESTIONNAIRE 


PURPOSE  OF  QUESTIONNAIRE:  The  purpose  of  this  questionnaire  Is  to  determine  the  extent  to  which 
you  perceive  the  RWR  PTT  as  potentially  useful  for  training  various  aspects  of  RWR. 

CONFIDENTIALITY:  Please  respond  candidly  to  all  questions.  Your  responses  will  be  treated  as 
confidential,  reflecting  your  own  personal  opinion  and  not  that  of  the  Tactical  Air  Command  or 
the  United  States  Air  Force. 

BACKGROUND: 

1.  Current  status  (check  one):  _ a.  F-16  8-Course  Student  Pilot 

b.  F-16  Instructor  Pilot 

c.  Fighter  Weapons  School  Student 

_  d.  Fighter  Weapons  School  Instructor 

_  e.  Other  (please  Indicate) 

2.  Total  Flying  Hours:  _ 

3.  Type  of  Aircraft:  _ 

♦.  Are  you  a  graduate  of  the  Fighter  Weapons  School?  Yes 

Date  of  graduation  _ 

5.  Are  you  a  graduate  of  the  Electronic  Combat 

Instructor’s  Course?  Yes 

Date  of  graduation  _ 

6.  How  much  actual  combat  experience  do  you  have?  _  hours 
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DIRECTIONS:  For  each  of  the  following  questions,  mark  the  one  response  alternative  that  best 


describes  your  answer.  For 

each  Item  that 

you  mark  * 

Not  Useful  at 

All*  or  'Slightly  Useful,' 

please 

tell  us  your  reason  In 

the  space  provided  at  the 

end  of  the  questionnaire. 

1.  How  useful  do  you  think  the  RWR  PTT  would 
students  for  each  of  the  following  areas? 

be  In  providing  effective  RWR  training  for  B-course 

Not  Useful 

At  All 

Slightly 

Useful 

Moderately 

Useful 

Useful 

Very 

Useful 

1 

2 

3 

4 

5 

a. 

Power  On 

1 

2 

3 

4 

5 

b. 

System  Test 

1 

2 

3 

4 

5 

c. 

Symbology 

1 

2 

3 

4 

5 

d. 

Indicator  Control 
Panel  Operation 

1 

2 

3 

4 

5 

e. 

Azimuth  Indicator 
Operation 

1 

2 

3 

4 

5 

f. 

System  Operation 

1 

2 

3 

4 

5 

g. 

Audio 

I 

2 

3 

4 

5 

h. 

Malfunctions 

I 

2 

3 

4 

5 

2.  How  useful  do  you  think  the  RWR  PTT  would  be  In 
training  for  operational  pilots  In  the  following  areas: 

providing  effective  RWR 

refresher/review 

Not  Useful 

At  All 

Sllghlty 

Useful 

Moderately 

Useful 

Useful 

Very 

Useful 

1 

2 

3 

4 

5 

a. 

Power  On 

1 

2 

3 

4 

5 

b. 

System  Test 

1 

2 

3 

4 

5 

c. 

Symbology 

1 

2 

3 

4 

5 

d. 

Indicator  Control 
Panel  Operation 

1 

2 

3 

4 

5 

e. 

Azimuth  Indicator 
Operation 

1 

2 

3 

4 

5 

f. 

System  Operation 

1 

2 

3 

4 

5 

9* 

Audio 

1 

2 

3 

4 

5 

h.  Malfunctions  1  2  3  45 
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Rate  how  easy  It  Is  to  use  the  following  RWR  PTT  features: 


Not  Easy 

Slightly 

At  All 

Easy 

1 

2 

Instructions  for 

the  user 

1 

2 

Touch-Sensitive 

Panel 

1 

2 

Moderately  Very 

Easy _ Easy  Easy  | 

3  4  5 


3  4  5 

i 

3  4  5 


c.  Graphic  Slnulatlon 

of  Indicator  Control 
Panel  and  AZ 

Indicator  1 

d.  Size  of  Color 

Graphic  Monitor  1 

e.  Menus  1 

4.  Overall,  I  feel  that  the  RWR  PTT  Is: 


2 

2 

2 


3 


4 


5 


3  4  5 

3  4  5 


Not 

Useful 
At  All 
1 


Sllghlty 

Useful 

2 


Moderately 

Very 

Useful 

Useful 

Useful 

3 

4 

5 

Use  the  reminder  of  this  page  to  explain  your  reasons  for  rating  the  RWR  PTT  as  "Not  Useful  at 
All*  or  “Slightly  Useful.*  In  addition,  please  add  any  coiwients  that  «ay  help  us  to  aake  the  RWR 
PTT  a  more  effective  training  aid. 
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